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SYSTEM AND METHOD FOR EDGE EHNANCEMENT OF IMAGES 

GOLD YARON 

FIELD OF THE INVENTION 

The present invention relates to systems and methods for enhancing 
images and especially for systems and methods for enhancing images including 
fuzzy edges. 

BACKGROUND OF THE INVENTION 



u 

0 

q An Image is a visual stimulus with intensity and/or color varying as a 2- 

j|5 dimensional function of spatial position (I = I (x,y)). An image is substantially a 

J3 15 continuous function. 

In order to allow recording, storage, transmission, and/or manipulation of 

^ an image, some kind of abstraction, or representation is needed. A given image 

il may have a plurality of possible representations. A representation can be 

^ symbolic (i.e., I(x,y) = x 2 +y), numerical - a table of numbers representing 

P 20 intensity values, chemical - exposed emulsion on a photographic film, etc. 

rjj 

The act of transforming of an image into one of its representations is 
referred to as Recording or Acquisition of the Image. Examples: Taking a 
photograph on film, scanning an image into computer memory, etc. While an 
image representation can be obtained from an image by recording it, it can also 

25 be synthesized, or generated artificially. 

Rendering is the act of transforming an image representation into a visible 
image. Examples: display of a digitally stored image representation on a 
computer monitor; development of a photographic film; etc. Because a 
representation is not necessarily unique, and a plurality of (visually similar) 

30 images may be identically represented, the rendered image is not necessarily 
identical to the recorded image, but an approximation thereof. It is also possible 
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to render an image from a synthetic representation. Such rendering can be used 
to visualize substantially non-visual (non-optical) phenomena. For example, the 
digitized signal from the detector of a scanning electron microscope (SEM) can 
be interpreted as a representation of an image, and thus can be rendered. 
5 While an image is substantially continuous, its representation is not 

necessarily continuous. In particular, a Digital Image is a representation for 
which the image area is divided into a finite number of small elements referred to 
as picture elements, or pixels, and a number (with finite precision) is associated 
with each pixel to represent its intensity. 
10 It is often useful to talk about regions and edges in an image. A Region in 

an image is a contiguous collection of image positions, which collectively 
□ possess a certain (substantially visual) property. Examples of such properties 

y are average intensity, average color, texture or pattern, etc. An Edge in an 

yl image is a (substantially contiguous) collection of image positions that 

yi 15 corresponds to the border between two adjacent regions. Much of the relevant 
^ information content of an image is contained in its edges. 

5 

O Images contain information. Some of the information contained in an 

image is more relevant and some is less relevant to the viewer. The more 
relevant information a user can extract from an image, the more useful the 

O 

pj 20 image. One obstacle for extracting relevant information is noise. Noise in an 
image consists of variations in image intensity (or other property) which do not 
carry information that is relevant to the viewer. Noise often makes it more 
difficult for the viewer to extract the relevant information from the image. An 
image may become contaminated with noise during acquisition, manipulation 

25 and/or rendering. 

A distinction is made between Fuzzy and Distinct edges. An edge in an 
image is fuzzy if a substantial amount of pixels near the edge and in one region 
are closer in property value to that of the other region, and vice versa. An edge 
is distinct, or sharp if the amount of such pixels is not substantial. An edge may 

30 be fuzzy due to inaccurate acquisition, to added (superimposed) noise, to certain 
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filtering (convolution, blurring), or to other manipulations. Edge information is 

more difficult to extract from fuzzy edges. 

Although the human visual system can extract information from images 

that are noisy, have fuzzy edges, or are otherwise less than ideal, it is possible to 
5 help it by enhancing the image. Image Enhancement Is a transformation of an 

image (usually by manipulation of its representation) in order to obtain a 

substantially similar image that allows better visibility of certain aspects or 

components of the original image, thus allowing better and/or easier extraction of 

information relevant to the viewer. 
10 Example: If a priori knowledge about a noisy image states that the spatial 

frequency of the noise is higher than that of the relevant information, one may 
H- apply a low-pass spatial filter in order to improve the ratio between relevant 

information (signal) and noise (signal-to-noise ratio, or SNR). 
4« Another example: a plurality of representations of the same image, each 

fc n 15 containing independent noise with certain characteristics, can be averaged pixel- 

wise to improve SNR. 

s An image with fuzzy edges may be enhanced to obtain a similar image in 

O 

rr which the edges are more distinct. Methods of this kind of enhancement are the 

f* subject of this invention. 

Q 20 Prior art smoothing techniques are discussed at chapter 3 of "The image 

m 

processing handbook" by John C. Russ, CRC press 1994. 

Noise reduction methods, such as smoothing and averaging out on one 

hand, and prior art edge enhancement and image sharpening methods on the 

other hand, are often contradictory in the sense that applying one increases the 
25 need for the other. Prior art methods often do not provide sufficiently visible 

images in cases where an image is both noisy and includes fuzzy edges. 
Scanning electron microscopes are known in the art. U.S. patent 

5,659,172 of Wagner describes a method for reliable defect detection using 

multiple perspective scanning electron microscope images. Scanning electron 
30 microscope images are generated by irradiating an inspected object with an 

electron beam, collecting signals resulting from an interaction of the electron 
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beam with a portion of the surface of the inspected object and processing the 
collected signals. A magnification can be achieved if the electron beam is utilized 
to generate an image of a portion of the object that is smaller than the cross 
section of electron beam. A disadvantage of such a magnification is that the 
electron beam also interacts with other portions of the inspected object, and as a 
result the collected signals include unnecessary information that cannot be 
filtered out. In many cases this unnecessary information causes the image to 
include fuzzy edges. 

There is a need to provide systems and methods for image enhancement 
of images that include fuzzy edges. 

There is a need to provide systems and methods for image enhancement 
of images that are generated by scanning electron microscope imaging methods. 

There is a need to provide systems and methods for image enhancement 
of images that are generated by scanning electron microscope imaging methods 
involving magnifications and especially large magnifications of an image. 

SUMMARY OF THE INVENTION 

The invention provides a method for generating an enhanced image, the 
method including the steps of: (a) receiving a matrix of pixels with intensity 
values, representative of an image; (b) generating a matrix of values 
representative of the estimated relevant edges in the image; (c) generating an 
enhanced image represented by a matrix of pixels such that pixel locations in a 
vicinity of a relevant edge are populated by values that are in response to 
intensity values of pixels that are further displaced from the relevant edge. 

The invention provides a method for generating an enhanced image, the 
method including the steps of: (a) receiving a matrix of pixels representative of an 
image; (b) generating a gradient image which is a matrix of values representative 
of a difference between values of adjacent pixels; (c) calculating a center of 
mass for each pixel location of the gradient image in response to gradient 
intensity values and location coordinates of neighboring pixels; and (d) 
generating an enhanced image by modifying intensity values of pixels of the 



matrix of pixels that are located in a vicinity of local centers of mass in response 
to intensity values of pixels that are further displaced from the local centers of 
mass. 

The invention provides a method for generating an enhanced image, the 
method including the steps of: (a) receiving a matrix of pixels representative of an 
image; (b) estimating at least one edge of the image; and (c) generating an 
enhanced image by modifying intensity values of pixels of the matrix of pixels 
that are located in a vicinity of that at least one estimated edge in response to 
intensity values of pixels that are further displaced from that at least one edge. 

The invention provides a method for estimating a relevant edge of an 
image, the method including the steps of: (a) receiving a matrix of pixels 
representative of an image; (b) generating a gradient image representative of a 
difference between values of adjacent pixels; (c) calculating a center of mass for 
each pixel of the gradient image in response to gradient intensity values and 
location coordinates of neighboring pixels; and (d) estimating a location of a edge 
in response to the center of mass. 

The step of generating a gradient image is preceded by a step of 
smoothing the image. The image can be smoothed to decrease noise 
magnification resulting from the step of generating the gradient image. The step 
of smoothing may include applying a kernel operation on the pixels of the image 
The steps of smoothing and the step of generating a gradient image including 
applying a Canny filter on the pixels of the image . 

Neighboring pixels are defined as pixels within a neighborhood 
pattern. The neighborhood pattern may be of various shapes, such as a cross, a 
diamond, a rectangle, or an octagonal region, and may have various 
characteristics, such being either symmetric around the pixel or asymmetric 
around the pixel. 

The neighboring pattern can be utilized to define a vicinity of a pixel. For 
example, a local center of mass is located in a vicinity of a pixel if a distance 
between the pixel and at least a portion of the local center of mass does not 
exceed (i) a length of the neighborhood pattern, (ii) half a length of the 



neighborhood pattern, or if the pixel and at least a portion of the local center of 
mass are located within at least one single neighborhood pattern. 

The invention provides a method in which the size of the neighboring 
pattern may be changed during consecutive iterations of the method. 

The invention provides a method in which a center of mass may be 
calculated by thevsteps of: (a) generating a sum result by summing results of a 
multiplication betwteen a intensity value of a neighbor pixel and a location 
coordinate value of fine neighbor pixel, for each neighbor pixel; and (b) dividing 
the sum result by a sum of gradient intensity values of all neighbor pixels. It is 
noted that a location coordinate value reflects a displacement from either the 
center of a neighborhood\or the gradient image origin. 

The invention provides a method in which a numerical measure of the size 
of an object within the matrix of pixels is calculated in response to the matrix of 
displacements from the local centers of gradient mass T 

The invention provides a method that limits or even prevents a 
modification of pixel values that are located in a vicinity of small objects. 

The invention provides a method in which the step of modifying may 
involve replacing pixel values of pixels that are located in a vicinity of local 
centers of mass with pixel values of pixels that are further displaced from the 
local centers of mass. The step of generating an enhanced image may include a 
selection of a pixel further displaced from a local center of mass for each pixel 
located in the vicinity of the local center of mass. The selection may be 
responsive to at least one of the following parameters : (a) a displacement of a 
center of mass and the pixel located in the vicinity of the center of mass, or (b) 
weight factor. The weight factor may be responsive to size of an object delimited 
by local centers of mass. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Reference is made to the attached drawings, wherein elements having the 
same reference numeral designations represent like elements throughout, and 
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wherein Figures 1 - 2 are flow charts illustrating methods 10 and 30 for 
generating an enhanced image, in accordance to preferred embodiment of the 
invention. 

5 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

For convenience of explanation, the following detailed description and 
associated drawings refer to systems and method for edge enhancement of 
images. It is noted that the invention is not limited to said signals and 
10 specification and can be implemented on various devices without falling out of 
the true spirit of the invention. 
r f l Figure 1 is a flow chart of method 10 of generating an enhanced image 

Q in accordance with a preferred embodiment of the invention. 

Method 10 starts by step 14 of receiving an array of pixels representative 
J? 15 of an image. It is assumed, for convenience of explanation, that the array of 



20 array of pixels is converted to a gradient array that includes 480 X 480 pixels. 
Each pixel value of the gradient images is responsive to two values - a horizontal 
value and a vertical value. The horizontal value represents a difference between 
the pixel's value and a value of an horizontally adjacent pixel. The vertical value 
that represents a difference between the pixel's value and a value of an vertically 

25 adjacent pixel. It is noted that the gradient image can reflect a difference between 
a given pixel and more than another near pixel and that a single value and more 
than two values can reflect a difference between a given pixel and other pixels. 
The calculation of the vertical and horizontal values is relatively easy and 
requires a relatively simple addressing scheme. 

30 Conveniently, step 18 is preceded by step 16 of smoothing the image. 

Step 16 is aimed to reduce noise amplifications resulting from the generation of 




pixels includes 480 rows and 480 columns, the pixels are generated by a 
scanning electron microscope such as Applied Materials CD-SEM. 



Step 14 is followed by step 18 of generating a gradient image 
representative of a difference between values of adjacent pixels. The 480 X 480 
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the gradient image. Preferably, step 16 and 18 are combined by applying a 
Canny filter on the pixels of the image. Canny filters are known in the art. A 
Canny filter can be described as a convolution of a Gaussian operator and a step 
operator. A Gaussian operator is a set of integers that approximate the profile of 
a Gaussian function along any row, column or diagonal. 

Step 1 8 is followed by step 22 of calculating a center of mass for each 
pixel of the gradient image in response to gradient intensity values and location 
coordinate values of neighboring pixels. Neighboring pixels of a pixel are located 
near that pixel. Usually the neighboring pixels form a neighborhood pattern. The 
neighborhood pattern is usually symmetric around a pixel, but this is not 
necessary. Commonly used neighborhood patterns include a cross, a diamond, a 
square and an octagonal region. 

For ease of calculation and addressing, step 22 is also conducted in two 
stages. During the first stage a horizontal center of mass and a horizontal center 
of mass displacement are calculated for each pixel of the gradient image. During 
a second stage a vertical center of mass and vertical center of mass 
displacement are calculated for each pixel of the gradient image. 

A vertical center of mass of a pixel of the gradient image is responsive to 
values of neighboring pixels and to the absolute or relative vertical position of 
these neighboring pixels. A horizontal center of mass of a pixel of the gradient 
image is responsive to values of neighboring pixels and to the absolute or 
relative horizontal position of these neighboring pixels. 

Conveniently, these mentioned above calculation can be defined as 
performing the following kernal operation: 



(i) 
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Whereas CMV x ,y and CMH x ,y are respectively the vertical center of mass 
5 value and the horizontal center of mass value of the (x,y)'th pixel of the gradient 
image. NB x ,y includes all the neighboring pixel of the (x,y)'th pixel. V| j are the 
values of an (i j)'th pixel, the (i,j) pixel being a neighbor pixel to the (x,y) pixel. 
DVjj and DHy being the vertical and horizontal displacement, accordingly, of the 
(Ij)'th pixel. DVjj can reflect a displacement from the origin of the gradient array, 
\a 10 a displacement from a predefined edge of a neighboring pattern, and the like, 
p Step 22 is followed by step 26 of generating an enhanced image by 

°j? modifying intensity values of pixels that are located in a vicinity of local centers 

yi of mass in response to intensity values of pixels that are further displaced from 

[7 the local centers of mass. The modification can be made by a replacement of 
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15 pixel values, but this is not necessarily so. 

Figure 2 is a flow chart of method 30 of generating an enhanced image 
in accordance with a preferred embodiment of the invention. 



Q Method 30 starts by step 34 of receiving an array of pixels representative 

of an image. 

20 Step 34 is followe^d by step 38 of estimating at least one relevant edge of 

an image. The estimation \$an be done by generating a gradient image, 
_ calculating a center of mass\but this is not necessarily so, and prior art methods 
for edge estimation, such as those described at ???? of "The image processing 
handbook" by John C. Russ, Cr\ press 1994, and other prior art methods can 
25 be utilized. 

Step 38 is followed by step 42 of generating an enhanced image by 
modifying intensity values of pixels that are located in a vicinity of 
estimated relevant edges in response to intensity values of pixels that are 
further displaced from the corresponding estimated relevant edges. The 
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modification can be made by a replacement of pixel values, but this is not 
necessarily so. 

It will be apparent to those skilled in the art that the disclosed subject 
matter may be modified in numerous ways and may assume many embodiments 
other then the preferred form specifically set out and described above. 

Accordingly, the above disclosed subject matter is to be considered 
illustrative and not restrictive, and to the maximum extent allowed by law, it is 
intended by the appended claims to cover all such modifications and other 
embodiments, which fall within the true spirit and scope of the present invention. 

The scope of the invention is to be determined by the broadest permissible 
interpretation of the following claims and their equivalents rather then the 
foregoing detailed description. 
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